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SAMPLING IN AGRICULTURAL ECONOMIC RESEARCH AND STATISTICS 


Introduction 


This morning Dr. Elliott briefly described the proposed program of research 
and statistics of the Bureau of ace ete Economics and suggested "2—way 
cooperation" with the Land Grant College In the field of Agricultural 
Estimates there is at the present time BN eres cu either with the 
State Departments of Agriculture and/or the Land Grant Colleges in 29 of 

the Field Offices representing 33 States. This cooperation is a natural 
outgrowth of the fact that the Federal Government is primarily interested 
in National Statistics with a breakdown by regions aha States, whereas State 
Agencies are primarily interested in State Statistics with ea breakdown by 


areas and counties within the State. The Federal Census provides agricultural 


statistics for both purposes every 5 years, whoreas the BAE provides curront, 
up-to-the-minute agricultural statistics. Actually in the field of 
agricultural statistics wo have "3-way cooperation"— The BAH, the Consus 
Bureau, and the States Agencios. 


This cooperation could well be extended, not only in the ficld of current 
agricultural statistics, but also in providing the data needed’ for the 
agricultural economic and marketing research descri ted by Dr. Elliott this 
morning. (The soundness of the conclusions reached in economic investigations 
depends in part on the reliability and the rcepresentativeness of tho 
statistics and data utilized by the research worker.) “Much of the data re- 
quired for economic analysis relate to the operation and business activity 
of some 6,000,000 individual farms and/or to thousands of buyors and pro- 
cessors of agricultural products. Frequent enumernations of so large a 
population are not practical because of their high cost and lack of timeli- 
ness, Sampling in onc form or another is the only alternative to complete 
enuncration. Since we cennot escape sanpling, we ebony d know more sbout it 
and how to use it oftectively. 


Sampling—A Universal Problem in Modern Scienco 


The problem of sampling and of drawing inference from sanple observations 

is a universal problem in modern science. All of the sciences face the 
problom of generalizing the results obtained fron an analysis of selected 
observations, to the phenomenon as a whole, i.o., gonoralizing fron a sanple 


to an estinate of the whole. Fundancntally it is » problen in estinoting 
or forecasting cither in space or in tine or in both. 


In the field of the physical sciences where. the phenomenon con be brought 
into the laboratory for nore or less precise obsorvetion and experinentation, 
the ‘basic problen of sampling is recognizcd and objective methods are being 
developed to nininize the nocd for intuitive judgnent in drawing conclusions. 
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For exanple, quality control, 
now recognized as essential in ihe ere cpaes of ceoeietes artic 

duced by ness production nothods, such as nilitary supplies, ammun 
olectric light bulbs, parts of tolephone and electronic equipnoent. 
and well cauipped laboratorics are meintained for tho purposo of qua 
control. The statistical technique of sequential analysis is a -conpe: 
tively recent developnent in the ficld of quality control. 


A boginning in the usc of the sampling concept has boen nade in ‘the f 
OFS7 -otcoroloey which incidentally has nuch in common with the sociel 
in that tho phenomenon of interest cannot be brought into the ‘labore 
Also in » recent survey made by the Ancrican Society of Civil Engincors 
its nonbership, concerning the phases of collese training that nee 
strengthening nost if the graduates of our engineering colleges are 
the denands of the job when they finished colloxe, some 35% of the_re 
specified the need for. nore thoroush trainin» in moder tatisticel + 
“Most of you sre fenilier with the rapid strides thet have been ay 
-recent yoars in developin; statistical tests for doternining the 
noss of insecticides, fungicides and’ of other chemicals and wig 
specific physiological purposes. 


You are all aware, at least in » genersl way, of. the development of 
efficient statistical designs eee Pinna plot and aninel experinents 
experinental designs thet neaterially incrcase the anount of infornation — 
obtained fron a given Caper are of labor and funds. A stotis tica 11 ne =, 
sound experinent:l design and aiethod of sempling within plots nals ee 
possible for the researcher to apply valid tests of significance to the 
results which natcrially reduce the necessity for depending “upon qneerts 
intuitive judgnent in drawing conclusions. Ho can, of course, choose tt 
-llevel of sigmificsnce thet he considers nppropriate to the phonorienor } 
investigated. As a result ho can state his conelusions aud reconmen tic 


in nore Crate a terns. & 


One or ine Hake trends in modern science fron ‘pure physics on ‘the oh 
to say psychology on the other is to increase ‘the elencnt of obj vity 
and door ease ve arca in which pecan iene is placed on intuitive Judgnen 


otis Beelenaas and oe tnoee Foes aro xen as ri 
possible utilizing the most accurnte and representative ‘observ 
obtsinable. i os 


In-econonic and other social science rescarch wo cena 
that we wish to investigate into the laboratory for study, 7 
ordinarily conduct Ge TLEOnNe field eae ea can a only 


these ante in testing “our ey Are 
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Ten Years of Progress in Developing Valid Methods of Sanpling Econonic 


Phenorse na, 


During tho last 10 ycars substantial progress has boon nade in the devclop- 
nent of valid nethods of sampling. In fact it was 10 years a¢0 last nonth 
when Professor R. A. Fisher was teaching in the summer school of Iowa State 
Colleze, that a week's conference of Corn Belt Stato Statisticians ond 
Statistical Econonists fron the Land Grent Collees wos held in Ancs. The 
problem for consideration at this conference was "How would one select a 
sarple of farms that would be representative of all the farns in a State, 
in e type of farming area, or in the country as a whole." Many different 
Opinions were expressed but none of then seemed very convincing. It was 
apparent that fundanentsl statistical research in sanpling was required if 
@ satisfactory solution was to be found. Consequently resolutions were 
adopted by the confercnce rdoommdnding that such research be imitinted and 
carried on aggressively. 


During the winter of 1936-37 a beginning was/mado by the BAB, finenced in 
part by funds furnishod by what is now imown as the Division of Statistical 
Standards of the Bureau of the Budgot. an infornal’intordepartnental 
committee was ors nized, made up of representrtives of the Census Buresu, 
Bureau of Labor Ststistics ond BAZ and Fredrick F. Stephen, Executive 
Secretary of the Anerican Statistical Associetion, Morris Hansen ‘was on 
this committee. J. J. Morgan was in charge of this first study in sampling. 
At the sugzestion of Ir. Pottit of the Consus Bureau, empirical tests were 
nade, using Census "minor civil divisions" as sampling units. As was 
expected, the MCD did not prove to be an efficient size of sanpling unit in 
estimating county, cro» reporting district or state averages and totals, or 
percentaze chenze from one census to the next. The MCD is too large a 
concentration of farms in the sampling unit and docs not provice sufficient 
geographic distribution of the sanple. 


In 1937 2 Bankhead-—Jones research project in sanpling was established in 
cooperetion with the Statistical Laboratory of Iown Stete Colleso under the 
imnediste direction of Professor Snedecor and Arnold J. Ming. In 1939 the 
College brouzht Professor Villian Cochren of Rothenstead Experinontal 
Station to the Laboratory. (In the neantine a nunber of pronisins young 
graduate resvarch assistants were taken on part time by the Laboratory— 
Harl Houseman, and Ray Jessen were menbers of this eroup.) One of the carly 
and highly successful pilot projects in enunorative sampling was a two-year 
‘matched sample" of about 400 farms selected to represent Iowa's approxi- 
nately 200,000 farms. It gave a highly eccurate estinate of the chenge in 
hog nunber. The preharvest whost survoy in tho Great Plains States was 
another. 


Meny of you are fanilisr, at least in a general wey, with the excellent work 
done by the Laboratory in cooperation with the Burcau of the Census and BAB 
in developing our present knowledge of the principles and practice of 
sanpling. The Master Sample designed to provide a cross section of farns 

in this country was developed jointly by the Iowa State College Statisticsl 
Laboratory, the Bureau of the Census and BAS. Robert Straszhein of Indiana 
in the next paper will describe the Mastcr Sanple. 


Lie 


The Bureau is continuing-ite. cooperative..rosearch, in. statistical Barat “4 
nethodology with the statistical Laboratories of the State ‘Colleges of Iowa 

ond North Gerolina. The Bureau of the Census also is continuing its . 
coopor:tion with the laboratory at Aries and with the BAH. Both laboratorics = 
have.as their najor function rescarch in fundencntal statistical nethodolosy | 
and underlying nathenatical theory. ‘Tho ‘laboratory.staffs: deal with’ 
statistical methodolozy as goncric. Sone of the investig»tions deal directly 3 
with sanpling problems of, interest to the Social ‘sciences, and sone relate 
prinarily to problems encountered in biological’ work. Representatives of: 

both laboratorics will describe their fields of work on Friday morning of ¢ 
this week. at lao . * aati) ‘cuit 


With 10 yoars of rescarch and considerable expérience in applying objective 
nethods of sanplin7z, not only in this country but also in parts of Burove, 
a body of knowledve has been acquired that’ gives us confidence thet we can, 
with further expericonce, eventuslly solve the problen of selecting an 
efficient, representotive sample of faris for any specified azricultural 
area, or for the United States as a whole . This is the problem that was 
seriously discussod at, Iowa State College 10 years ago this sunner.. 


Psychological Factors in Saupling 


Although the statistical problen of ‘selecting en efficient representative 
‘ ganple, one that will mininize error in the statistical sense, and at the 
sane tine nininizo cost is probably our most important and fundanental \ 
problen, it is not, however, the only important »vroblen confronting us at 4 
this tine. All of you who have participated in taking a schedule or 
fern record" by the intorview method are aware of the nistakes and errors 
(non-senpling errors) that can creep into the record. These errors cen be 
caused in many ways. Some are caused by the wy the question is stated by 
the interviewer, by how the respondent understends the question; by the 
frene of mind or the nood of the reepondent; or his inability to renenber 
events or facts that occurred sonetine in the past; if the schedule is too 
long, by fatigue on the part of both the respondent and interviewer end 
vague instructions and definitions of concepts. Lack of training and 
fanilisrity with the subject on the part of the interviewer or his super- 
visor ell contribute to these “hunan errors" as contrasted with sampling 
errors. 

4, 
In seeking 2 solution of this problen of nininizing f"hunan errors", we need 
to draw on the basic principles of psycholowy, sociology and related social 
sciences that deal with an understanding of hunan behavior and hunan we 
weaknesses. Tho Division of Speciel Surveys of BAH has nade phenononal @ 
progress during the last 6 years in neeting many of these psychologicel 
problens that arise in connectim with enunerative and interview sampling. 
The two leading psychologists of this Division, Rensis Likert and Charles iy 
Cannell will discuss sone of these problons Thursday. They are problens 
for which we nust draw upon our own experience and so enlled figonnon sense" 
in seoking solutions. They also are problens on which a great deal of 
research nnd experinentation is needed to deternine basic principles and 
efficiont techniques. I think that we all recognize that a chain can bo no 


ie 
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stronger than its weakest link. Respondent and interview bias are weak 
links in this chain today. Bese ereE to strengthen. these weak links will 


be undertaken soon. 
, 


Choice “Of ‘Sempling Methods rae 


What choice of sampling poe wae ata agricultural statistician and tho 
research economist have? What considerations should be woighed and balanced 
in deciding on tho method of sampling to be used with a specific problem? 


We are looking forward to the timo when both the agricultural statistician 
and the investigator of agricultural cconomic and morkcting problems will 
have sufficient funds to be in position to utilize whatcver method of 
securing his basic obsorvetional data as will provide the necessary degree 
of accuracy at a minimum cost. If the numbor of individucls.in. the popula- 
tion that forms his "universe of inquiry" is small, 2nd these individuals 


show a high degree of variability, cithcr in space or time, and’ there is 


need for great accuracy, a complete enumoration is-undoubtedly the most 


satisfactory method for obtaining "the required data. Such might be the 
case if he wanted to determine the distribution of fruit trocs by kind, 


varicty, and age in an important commercicl orchard area. Anothcr example 
might be a marketing study where’ the totr2l number of processors or handlers © 
is relativoly small ond thoir plants vary greatly «s to capacity. 


At the other oxtrene, the invostigetion night requiro a snall "hand picked" 


sample or judgnent sample of farms or processors for detailed case history 


investigations. It can be roadily denonstrated that with a very snall 
sanple,. probably less than 5, 2 judgment sarple bascd on rather conplcte 


but general information will provide a more representative samplo than 


stratificd randon. Selection techniques. However, as the size of sample 
increases, it is surprising how soon random selection provides a more repre- 
sentative and dependable sample. y 
It is in between these two linits of the conpletce enuncration on-the one 
hond and a hend picked sample of a very few observ>tions for case history 
studics on, the other, that modern scientific saipling bceomes a neccessary 
and. valuable aid to, both the statistician and the economic investigator. 

It is here that the choice of the nethod of serpling becones fully as 
inportant to hin as is the choico of the experincntal design to the 
agrononist. ‘In fact the design of an cxperinent and the design of a sample 
both sten from a consideration of the sane fundsncntal concepts in-nathe— 
natical statistics. Broadly speaking he has a choice of the three prinary 
altornatives of (1) a nailed sample, (2) a presclectod interviow or cnuncra- 
tive sample, or (3) a combination of neiled and interviow NS 


She fina ted Sample: Gonerally Beart oie eheerndas is of neem 


_ inportance, absolute accurncy sccondary, ard reliable chock data such 
as narket receipts and "bench narks" from consus data: are available 
historically, one can froquently rely on a nailed sample ‘provided no 
sharp or far reaching changes are taking place in the underlying 
physical and psychological situ» tion that may cause the bias or 
representativeness of the nailed saiple to change in tine. One can 
seldom tell in advance when ond under wheat conditions these biases 
will change, or in what direction, or how nuch. 


/ 


PBs 


Most of the sampling done in the preparation of crop and iivestock * 
estinates has been by mailed inquiries to lists of correspondents 
naintained by the State Statisticians or. through the Rural Meil 
Carriors. Fortunately by utilizing the census data as a bench mark” 
every 5 yoars, and narket receipts, cotton ginninzs and other chock 
neue including Assessor's annual farm censuses of crop acreages 

about 10 or 11 inportant egricultural States, and livestock assoss- 
ae data in more then half of the States, reasonably satisfactory 
State and National cstimates have boen nade for nany important itens. 
The comparison of crop estimates with census data for 194 substantiates 
this conclusion. 


A Preselected Interview or Enunerative Sanple: In the broad field of 
agricultural statistics and research there are many phenonena that 
experience has shown cannot be senpled satisfactorily by any forn of 

a mailed inquiry. Eithor the type of schedule is necessarily so long © 
and complex that an interviewer is required to explain what is wanted 
to the respondent and to "keep at" hin until all the information is 
obtained, or the subject natter of the inquiry is such that correspond- 
ents who will reply voluntarily by nail are highly selective. | It is 
with phenonena of this nature that the preselected interview senple 
should be chosen. 


With this type of sample, valid and efficient sanpling nethods are 6 


used in designing the sample. The farms or other units: of observation | 
are preselected for the interviewer naking the survey. The interviewer. | 
exercises no direction in choosing the respondents that conprise the 


‘sample. The farn on the nuddy road, the farm with the rundown build- 


ings as well as tho prosperous Tr oakine farnstead, all have a imown, 
probability of being included in the sample. | By the sane token, . 
friends of the interviewor-~ those belonging to his church, his farn 
organization or his lodgc-—— are no more likely to appear in the. survey 


than air euls belonatng to any other ST OUP. 


‘The nedoe AAvantal ze of the respondent preselection procedure. is that 


it is nathenatically and statisticelly sound« For this reason it. 

taps a vast source of knowledge, both in the science of statistics 
and mathenatics and in the fields of science where statistical methods 
have reached a high state of practical application. A transfer of 
these techniques from other ficlds nekes it possible to provide. 
surveys of increasing aR Cur esy ee at decreasing cost. 


The usc of basic sampling nothods which are statisticelly valid is 


anatter of deep significance to agricultural econonic and narketing ti 
research. Statistically valid sampling nethods conbined with. properly 


trained and supervised: interviewers nakes it possible to deternine | 
the degree of accuracy of the peels results.’ pte can be done with ) 
no other nethoey, of | (SnD De. 


d 


in 
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In the case of the proposed January 1947 Enunerative Sanple of 
15,000 farns sclected .to. provide. a representative cross section of 


_ Anerican farms, the ne thod of selecting thé s»mple is as follows: 


(It will be described nore fully at the Thur sday eee neeting.) 


a. The agricultural area of the United States is divided into about 


400 homogeneous areas or etrata consisting usually of several 
counties cach. The stratification is based primarily on the type 
of farming areas nodified to sone cxtent in ordor to provide 
epproxinately the sane nunber of census farns in cach. Those 
strata with only a few exceptions ate es within: the boundaries 
of a . State. 


b. Within each of these 400 strata one county is selected at 
randon, and 


c. <A pert-tine enunerator will be hired in cath of: these counties 
or 400 in all. In important agricultural strato, :one additional 
county usually will be selected at random for inclusion in the 
sanple, ond in a few cases two additionel countics, thus making 

a total of perhaps 900 sample countics. 


a. Within cach of these 900 counties, segnents of he Master: Sanple 
will be. selected at rendon end the interviewer will be expected 
to enunerate the farmers having fernstesds in these ‘segnents. 
Detailed maps and aerial photographs will be furnished the inter- 
viewer to cnable him to establish the boundaries of these sarnple 
segments. There are fron 4 to 6 ferns in cach Se 2 ae 


e. With a 15,000 farm sanple, fron 15 to 20 farms will be enunerated 
in each of these goO countios. 


f. Tho 41 State Ag sricultural Sati derosere! offices will sclect, train 
and supervise ‘these enunerators. The porson in each of these 
offices who will supervise this survey will receive a week'of 
instruction at one of three areca conferences »rior to Docenber 15, 


PET OUGE 


This Hrieridgcexi Seton of tho January 1947 Enunerative Survey shows 
specifically what is meant by a . Presclected Interview Sanple. It 


‘will provide a representstive, gonernl purpose sample of farms for 


each State, as cach farm in the State has a known probability of 
being included in the sanple. Although representative, it is not 
necessarily adequate -s to size on a State basis for nost purposes. 
A substential increase in size would improve its: atequacy. and reduce 


the sampling error. 


“tae 
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The remaining alternative method of sampling involves a combination 
of mailed sample and preselected interview semple. This combination 
method would be appropriate where the mailed sample has measureable Pl 
validity but connot be depended upon to produce results of necded 
accuracy. ‘The two types of samples could be taken simultancously 

with the interview samplo in say 20 to 50 percent of the geographic 


areas and the mailed sample in all areas and regression (correlation) . 
methods used to correct tho mailed sample for bias. Tho mailed sample 

would heve-a nore uniforn scatter over a State or region, whereas the rf 
interview semple would be taken in scloctced counties « Yhe non- 2 


respondents fron the mailed sample nay be sonpled by theo interview 
nethod. These and other ways of combining these two methods of 
senpling will be brought out by Walter Hendricks and Arnold King on 
Thursday. 


It night be well at this point to bring out nore clearly the considerations 
that must bo carefully weighed and balenced each with the other by the 
statisticien or research ccononist in arriving at a choice of sanpling 
nethod to be used in connection with any specific problen. The nore 
inportant consideretions or factors are as follows: 


ue 


The first and frequently the nost important consideration is the funds 
end resources of manpower available for the job. Money and tine are P 
usuelly the most critical liniting factors in saripling. The desire 

for accuracy and » sound basis for generalization is usually, but not = 
always, practically unlinited. . ¥ 


The degree of accuracy required in the finel results whether these 
results aro cstinatcs, or conclusions obtained from econonic investiga- 
tions and research. 


The nature of the quantity to be ostinated, whether the adsolute 

level or pmount on the one hand or relative accuracy such as the 
change of level from one period to the noxt, expressed as a percentaze 
on the other. For example the nunber of hogs or bushels of corn 
produced, the year-to-year change in the nunber of hogs or production 
of corn, or within season variation of prices or narke tings. 


The tine available. Often timcliness is nore important than a high ° 
degree of accuracy. This is cspecially true with estinates and fore 
easts of short season comnercinl fruit and vegetable crops. A rough 
approxination of the change in supply due to frost. danage on perish— 

able crons, promptly made, usually hes greater econonic significance * 
then a ouch more accurate estinete that comes out severel woeks or 

months later. 
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of fruit and vegetable crops, slaughter of livestock, etc. If 
relinble chock data ere available, the statistician can get along 
pretty woll with a sample thet shows rclative change accurately. 
This is one of the reasons why the mailed samples have proved so 


\ useful for itens for which dependable check date aro available. 
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6. Inate bias in the observations. themselves. | In the case of cash crops 
before they have left the producer's hands ‘there is a. general tendency 
to obtain’ ‘reports, whether by mail or ‘interview, that are understate-— 
ments of” ‘the true acreage or production. In such casea a sample of 
direct plant. ‘observetions is the only sound approach, such as boll 
counts of cotton, “head sampl os of wheat, car samples of corn, or the 
use of the crop meter. to. measure cheng 70 in crop acreages from year to 
year. 


T« ° Extent to which ‘generalization from the sample data is thought desirable 
and necessary. ‘thile the ‘investigator nay think he can limit the applice- | 
tion of his conclusions to the observed cases, perhaps farms that he has 
selected for his survey, he cannot prevent pthieee fron generalizing and / 
using these results far beyond what he originally intended. / 


8. Fund of knowledge already available to the investigator. If very little 
is known about a specific or perhaps complex phononenon, it nay be pre- 
ferable to make 2 detailed case history study of a few hend-picked cases 
rather than obtain a representative samplc; or the investigator nay be 
satisfied with most any kind of a sample in order to get sone deta with . 
which to work” end to serve as a basis for more scientific investigations 
lator. 


In the ficld of Agricultural Estinates the first 5 considerations have beon of 
parenount importance. Funds and resources have never been adequate to obtain 
estinates with the degree of accuracy and tineliness desired by the statistician, 
the economist and others using his data. Consequently. the agricultural - 
stetistician hes been compelled to use mailed sanples with s varying enount of 
subjective interpretation on his part. The nailed pales is usually the least 
expensive method of sampiing and the schedules can be mailed out, returned and 
summarized with sufficient dispatch to neet rigid dead Oe SWA encase, 
Fortunately, with census date bench marks anc other check data fron comer- 
cial sources, he has becn able to utilize a nothod of seupling which usually 
showed change more accurately than absolute values. 


With crops thet producers tend to habituelly understate prior to hervest, the 

agricultural ste “tistician has shown considerable ingenuity in developing 
statistical methods for correcting the bias in the sample using census, 

peer es or commercial nerketings; he has learned how to got infornstion fron 
key persons fanilicr with the crop locally and how to evaluate it for bias. 

He has developed methods for observing the growing crop in the field by use 

of the crop meter and plant counts and neasurenents. 


Experience with Enumerative Surveys. 


The Division of Rural Population in cooperation with Agricultural Estimates 
has conducted four nation-wide enumerative Farm Wage and Labor Surveys during 
the last year and a half-— March, Mey and September 1945 and July 1946-- and 
also special Farm Wage and Labor Surveys in 60 commercial crop areas covering 
74 crops in 15 different States. The latter were designed to obtain wage 
rates received by the large number of seasonal’ workers employed in harvesting 
certain commercial crops and also ‘other specific information such as age and 
sex of workers, hours worked, source of workers and piece rates, 
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The sample for the four nation-wide Farm Wage end Labor Surveys was designed 

to provide for national estimates and estimates by the four major regions of a 
the United States. It was not designed as a basis for eetimates by States or 
small groups of States. The sample of about 20,000 farms was taken in 158 

sample counties; one or more sample counties were selected in each of 101 

strata. These strata were determined on the basis of the 10 major typo of 
farning oreas and the four major regions of the United States. 


The Division of Special Surveys,. under the able leadership of Ronsis Likcrt, 
hes hed broad experience since 1939 with interview surveys focused prinsrily 
on ottitudes, but more recontly in cooperstion with Agricultural Estinates 
with enumeretive surveys. The objectives of the latter have been to obtain 
econonic deta from a sample of preselected farmer respondents. 


The Quarterly Surveys of Agriculture (QSA) made in April, July and October, 
1945 end Jonuery 1946 are probably of greatest interest to the persons attond- 
ing this conference. - The primary objectives of QSA may be sumnarized as 
follows: 


1. °To sec whet could be done by enunerative sapling in getting infornetion 
on tonics end items that cannot be obtained satisfactorily by neiled 
samples or eny other means. 


Qo To obtain a sample from which nationl estinates could be nade for 
conparison with official BAH estinates. a 


Se: To obtain data on individual farn oporstions for use in econonic 
analysis. 


4. To gain experience in conducting = nation-wide cnunerative survcy On. 
econonic topics. 


A semple of 101 countics, one in each of 101 strata mentioned above, was used 
for the QSA with about six Master Sample scgnents within cach of the 101 sample 
counties. <A total semple of nearly 3,000 farms was planned. The samo farns 
were visited each of the four quarters excopt as farns dropped out of the 
survey. Tho nunber of useable farn schedules obtaincd was as follows: 


1945 April ------- 2803 

July- ------- 2625 

October - - - - - - 2530 oT 
1946 January - - - - - 2345 


The results obtained fron the QSA were about what the statisticiens expected — a 
fron a snall nation-wido snmple. Less than 0.05 percent of the total nunber 

of farns in the Unitcd States were included in the sanple. Its geographic 
distribution was linitcd to 101 countics, or about 3 percent of the total 
counties in the United States; in fact tho over-all sampling rete was slightly 
less than one fern per ngriculturel county. Furthernore the verinbility of 
farms over the entire United States is high. 
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With such a sample one could expect to obtain reasonably valid national 
estinates and frequency. distributions only on phenoncna thet occur on a high 
proportion of farns or with aggregates of several less frequently occurring | 
itens. A broakdowm by the four major regions would not be practical. ‘Howover, 
the i i ad results are Beereenercee ORR 


Ra aS 


Total acres in‘crops in the Qs wos slightly aint than was shown by the 


consus ° 


Land ih farms in QSA was somewhat lowcr then the census. 


Cash farm income was tekon quarterly along with inventories of livestock and 
crops. 4 netional ostinate of livestock and poultry seles was sbout 20 percent 
below the BAH estinates; livestock and poultry products was about 15-20 percent 
lower; and crop sales were about 6 to 8 percent low as Gornpared with BAB 
estinates. The aggregate of these three sales was about’ 10 percent less then 
BAEZ estimates. In the case of non-farn incone the Q8A estinates were about | 
10 ‘percent below the BA# estinates. 


A thowah: no complete check has been nade of. cash farn © expondi tures, our 
inpression is that the estinetes fron the QSA sa: sample : may be in excess of the” 
true values. Infornetion on narket outlets for oggs, live “chickens and hogs 
was obtained each quarter. The data appear to be reasonable and useable’ when - 
the four quarters are added togethor. -‘It would appear feasible to compile 
these data in three categories-— sold direct to consumers, to local narkets, 
and elsewhero, 


There is little ovidence that be et8d intentions to nerket cattle are reliable 
indications of future marketing on a nation-wide basis. Most of tho farners 
who indicated thet they would sell cattle did sell but about an equal nunber 
of farncrs, who said they would not scll, did sell. The reasons for’ this 
behevior could not be obtained satisfactorily by part-tine interviowers. 
Intentions to soll appear to be loast dependable with milk cows and nost 


dependable with. fattening steors and heifers. The sample wes too small to 


pornit special , trbulation for the Corn Belt States where intentions to sell - 
cattle night have nore Meoning. pom . 


Comparisons of household dle daallses 8 with 1945 consus indicate a very close 
correspondence. ae 8 ASG. f : 

The infornation obtained on insurance carried by farners does not appear to 

be reliable. The questionnaire construction was poor and it, is'very, diffiealt 
to obtain eccurate information | on this Bopee because of the end 5 aback in vat on. 
insurance is writton. : 


A check.on short-term debts indicates. that the QSA was. about 40 ante short 


of officiel BAE estinates, however the rélativo enounts, of. short—tern. debts 
owed to different types .of lenders were probably qui te. scouraty. ‘The. data on 
farn nortgage debts have not yet. been tabulated. ) 


Ura 
ay 


Most of the estinates on finenciel assets and investments arc about one half F) 
as large.es regular BAH estinates, however, regular BAE estimates cover farn 
population while the QSA covers only fern operators. Again the relative 

" proportion of assets appears reasonably accuratc. . Se 


Tho data on nedicsl care received by farm fenilies were new information and. ay | ae 
check data arc not available, however, the results appear to be ‘réasonable. 


Adninistrstively the experience with the QSA was not satisfactory. . The 
schedules contained so nany different topics and such a lerge nunber OF wana 
questions to be answered by the respondent, i.e., "respondent itens!# that it. 
was not possible to adequately train the supervisors and interviewers. :The ; 
length, complexity end nature of the schedules were such that nany interviewers 
and some supervisors quit the job and it was extrenely difficult to replace ~ 
and train new ones. As a result, overhead and intcrvicw expense was excessive. | 


Although actuel interview time ranged fron 45 minutes on small farms to an. 
hour end a half or two hours on large farms, the enunerators averaged only .. = 
about 1.8 schedules per 8 hour day. uch time was consumed in locating respond- 
ents and in neking "enll backs" whon farmers were not at home the first time» a 

the interviewer called For exanple, the cost of part-tine county supervisors _ 

and enunerators for saleries and travel. averaged nearly $5.00 per useable ef 
schedule for the April QSA. ; ; HE: 


\, 


The coding, editing and punching of the cards for the- QSA was also 8 SLOW, sia Ge 
tedious job thet has only recently been conpleted for the January 1946 QSA.gy 


Forty-six punched cards are required for the data on each farn. 
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Our experience with the QSA indicstes conclusively that the econonists of a as 
research organization cannot get all of the infornation they wuld like to © 
heve from one survey or with one schedule even when the survey is sproad over the 
four querters of the year. Tho greator the nunber of different "topics! or 
subject matter fields included in a survey, the nore difficult is the natter ce 
of treining and supervising of non-experienced part—tine interviewers. Hach aus 
new topic must be introduced by the intervicwer for the purpose of establishing 
the necessary rapport with the respondent. Consequently the grenter the nie 4 
nunber of topics, the longer the interview tine and the higher the cost per 
schedule. Furthernorec, topics thet are likely, to- cause resistence on the part — 
of the respondent should be avoided, at least until the interviewers become — 
nore experienced and specially prepared instructions end treining can be provid 
Dr. Likert and his staff have demonstrated that these difficult topics can be 

hendlod by interview methods by well-trained and experienced enuncratorse : 
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Enumerative Sampling Program .... 1 RE pte ee ae 


Objectives: The primary objectives of the Bureau's program. for Snunéeatteeen 
sampling are: w dans Cartas oR A 
1. To make full and effective use of the constantly improving techniques of-- 
‘gampling in meeting national and State needs for. more reliable and useful 
‘agricultural statistics and for representative economic data for analysis 
and research. The sampling techniques to be used in each instance are 


i a 


those that iwill provide maximum accuracy at/-minimum cost. From the researc! 
in sampling now underway and from the experience to be gained’ in this- 

' sampling program, it is expected that more powerful techniques will be 
developed that will combine. the advantages of wing nailed igi and the 
Pipe raped enunerative aapples: aap 


aa LO encourage .end develop Pee CP uae Sored than HeteeBeLhe Bureau and State 
agencies+—:Land Grant Colleges and State Departments of Agriculture-- in 
the entire field of agriculturel ‘sampling for the purpose of placing a 
more sure foundation of methodology under current agricultural stotistics 
end agricultural economic research. . Such cooperation will be mutually 
advantageous. The Bureau is primarily interested in a representative 
semple that is sufficiently adequate as to size to provide reliable 
State statistics and also dependable ecstinates for arees within the State 
such as typc-of-farming sreas and even counties. We all need the sane 
basic date concerning agriculture and narketing. <A pooling of necds, 
ideas, technical "know how" and financisl and personnel resources can be 
made to pay handsome dividends to Anorican agriculture and to the taxpayer, 
who after all is our employer. 


pees ationt The Bureau, with its 41 State Offices, is in position to 

provide the technical direction and supervision necessary on a nation-wide 

basis to insure comparability in estinates based on sample data. The agricultur: 
statisticien in each of’ the Buresuls State Offices are responsible for tho — 
actual collection of sample data, whether it be e mailed or enumerstive sample. 


As soon as the s»mple counties in each State are selected, the State Offices 
will select,::hire and “train thé’local part-time interviewers, and directly 


supervise their work of enuneration of forns in the selceted Master Sanple 
segments. The number ‘of strata and the number of part-time interviewors per 


State varies from'one in Arizones and ais ii: each in ergs Indiana, 


Weta tas ay ‘aria and Georgia, to 22 in Texas 


lator tie State Offices will sunervise the Bantins: and coding of the schedules 
before they are sent to the Washington Office for entering. on punch cards, 
machine tabulation and summarization. Once the data.are on punched cards, a 
duplicate deck of cards can be furnished cooperating State agencies having IBM 


equipnent. 


In those States which desire eo larger sample for the purpose of within-State 
analysis or estinates for areas within. the State, the sample can’ be made as 
large as State sponsored funds and other needed assistance will permit. I+ 
merely involves an da iaecmgee “of sabe et oe nechinery. 3 


Semple Design: The Banus is now designing a He tion whee tkenevel = purpose 
sanple that’will be suitoble for use‘in making estinates.by States for itens 
commonly occurring on ferns. Tho new sample is highly flexible as it can be 


contracted or expended, or changed from year to year with minimum expense and 


difficulty: | As alroady explained, the new sample for use with the: Janu: ry 
1947 enuné rs tive survey will consist of 4 or 5 Master Senple segments, -of 15 
to 20 farms each, in each of nearly 900 counties, or a4 totel sample of about 
15,000 farns for the United States. The QSA sanple of.less than 3,000 farms 
was vaken in 101 countics. 


In'selecting the sample counties, all the agricultural counties of the Un 
Statcos were grouped into 400 horogeneous areas.or strata with about the same 
nunber of farms in each using the tyve~of-farnming area classification. In- 
only a very few instances do these strata include counties in two adjacent 
States. One county was selected at rendom in each of the 400 strata. The 
pert—tinme interviewers will be sclected from among persons living in these 
counties. Each intcorviewor will cnunerate the Master Sample segments in 


hone county and callbacks will be linited largely to these counties. In 
addition, nearly 500 other countiés will be selected at randon in these 4400 
strata, one or two in each strata. Tho pert-tine interviewor alsocwill? «o> 
enunerate the Master Sample’ segnonts.in thesc additional 1 or 2 counties in ~ 
his strata. } Ae is ' SOR Sete 
The inportence of getting a wide distribution of the sariple anong counties i 
appreciated when it is realized that a 15,000 farn sample in 800 countics 
be about equal in statistical reliability to a 20,000 farn semple taken in \ 
counties. Be he eee "Ee 
oaths 
dhs 2s 
reduced to the 400 countics in which the interviewer has his home, or it co 
be expanded to 1300 or 1700 counties by the addition of one or two-sample | 
counties in each of the 400 strata.’ The size of the sample also can be 
expanded by increasing the nunber of Mastor Sample segnents to be enunerat 
within the sanple countics. iia # | 


Frequency of Sampling: The Burcau ‘is planning to take enumerative surveys | 
quarterly—- carly in January, April, July and October. Because of tho in: 
funds now available for this work, the Jenuary 1947 survey of 15,000 farns 
be a major survey and the one in April a ninor survey with probably only » 
{1,500 farns. The schedule also will be shortor in April in order to keep 
expense to the lowest possible anount. It is hoped that funds will be 
to permit a 15,000 sample in July and a nuch larger najor sample in Oct 
On the basis of experience to date and need for the information, there w 
appear to be anple justification for at least one and probaoly two majo 
end two minor enumeretive surveys per year. The tining of the major su 
night vary gcographicelly because of the seasonal nature of farm opers 
as planting, harvesting and narketing. et 
: (ps ae shel 
oe bee ... . Some tyves of sgricultural and marketing phenonena, 
chenge’ so Slowly in time that data are necded only biennially or at lon 
intervels or perhaps the census can get the data every 5 years. Other - 
‘are so dominated by year-to-year: influences that they are needed annual 
Still others are so closely associated with the"march of the seasons" that 
obsorvational data are required quarterly or at least very soon after the 
events occur in order to nininizo nenory bias on the part of the respor 
Timeliness is also important fron the standpoint of the usefulness of t¢ 
information. eu 


Many of our inportant ccononic statistical gerics are on en annual >: 
January coming as it does innedintely -fter the close of the yeer is 


tine to get certain infornetim for a full enlendar year such as cash 
income, non-farn farily incone, farn expenses, and farm population, | 
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is also the accepted month in meny areas for teking inventories of livestock 
end machinery. On the other hand, informetion concerning lend use and acreages 
of verious crops, cen probably be obtained best in October. There aro other 
itoms with high scesonal varisetion that should be gotten quarterly, such as 
fern labor and wages, nilk end egg production and stocks of grain on ferns. 
There are other classes of items that can be enunercted satisfactorily in any 
of the 4 quertors of the yeer. 


In view of the nany demands for enunerative survey dots and the physicel fact 
thet each survey schedule mst be kept within precticel opersting linits, it 
will be necessary to work out an integrated annuel end quarterly senpling 
Scheme extending over several years, one that will utilize both enunerstive. 
and meiled ssmpling techniques singly ond in combination. 


selection of Topics and Items: The subject matter ficlds or "topics" for 


which representstive ssnples ere needed by the agricultural statistician and 
research econonist ere wide and diverse. The najor lines of desta which should 
be collected prinarily through enuncrative survey procedures arc listed on pages 
32 and 33 of the Proposed Progran of Research end Statistics of BAE discussed 
by Dr. Elliott this norning. This list, with sone modificntions, is as follows: 


1. Agricultural enployment and wages paid to hired agriculturel workers, 
including perquisites. —- Since funds have been directly apnro»nristed for 
this topic, it will be included quarterly. 


2. farm accidents and injuries causing loss of tine. — Very little relicble 
infornation is aveilable anywhere on this inportent topic which so vitally 
affects all farm workers. For at least = year this tonic will: be included 
quarterly. 


3. Farm populstion and migration. -—- This toric is pretty woll covere fron 
other sources, but farm populetion is needed as a control item for anelysis, 
especially with topic 2 above. 


4, Acreage and production of crons, stocks, livestock.inventorics and produc-— 
tion, production of nilk end milk products, poultry and eggs, wool end 
honey, slaughter of livestock, prices: paid and recoived by farners, land 
values. —~ These ere all basic sagricuiturel statistics, soe’of which 
could undoubtedly be strengthened by emmerstive senpling or by es conbina- 
tion of nailed and enuneretive sanpling. 


5. Farm oper-ting expenditures by size distributions. — This topic is necded 
currently along with farn wages to obtain » relinble pisture of costs for . 
Anerican agriculture. It should be included annually and perhavs quarterly. 


6. Oash income of farmers and farm families, levels and size distributions. — 
This infornetion is basic to agricultural ceonomics and is »lso needed to 
complete the record for national incone. It should be included annually 
and perhaps quarterly. 


7. Expenditures and savings of fern femnilies. -— This isa 
and difficult topic to handle by any method OLY intervi 
Bee OU ge Gee ‘are involved, the farn operator and ats wife. 
8. Income aie cel purions of farm laborers! fenilics. 
9. WNunber of all farms, and nunber of farns reporting najor crop al 
stock items. — Tho use of area ssmpling, i.c., Master sa 
should enable us to obtain this information. 


10. Tonure and land ownershin. 


11. Gross and net rent payable on farn lands and Lendlord's share o 
' governnent paynents. 


12. Farm practices, including availability aid use of nodern tee no: 
devices end procedures. 


ais Anount and characteristics of the various types of sohane used 
— This topic requires well- trained and oxperienced enunerr to 


14. Methods of narketing. 


15. Goods and services secured without cash CEOS as 
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being placed on a State or ne OHERS survey . Not all of tie wen. 
are required in the sanc degree of accuracy, with wee sane gy 
same geographic eapeat or in the same detail. : 


Enunerative Surveys for 1947: | 

The topics sientoa so% the January 1947 schedule include: 
L. General 

2. Farn Tenure and Rent. 
3. Value of Farn 

4. Farn Dwellings and Population re Oe 
5. Fsrn Wages and Employment for the week ending TRAE ie 


eee nunber of man-days of hired labor that will be r 
1947 eo 


J tele 
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Accidents involving loss of time during October, Novenber & Decenber 1946. 


Livestock Numbers, January 1, 1947 — cattle, cows, cattle on ernin food 
and narketing intentims, and workstock. 


Fearn machinery inventory-- age and size or model of automobiles, tractors, 
combines, corn pickers, nultiple row cultivstors, windrow pick-up balers, 
milking machines and value of farn machinery. 


Cash Farm Expenses, Operstor and Landlord. 


Cash Farn Receipts, Operator and Landlord. 


Other Cash Inconc, Operator 


Fanily Living Expenses —- Total only to be obtained fron the operator. 


This schedule will contain about 25 percent fower "respondent itens" than the 
avereze QSA. 


The topics planned for the smaller April 1947 Survey of about 7,500 farms on 


a 


neue fae 


2 subsample of the Jenuary Survey are about as follows: 


General 

Farn Population 

Farm Wages and Employment for the week ending April 12, 1947. 

Accidents involving loss of time during January, February and March 1947. 
Milk and egg production yesterday. 

Cattle on grain feed and narketing intentions. 

Farn Grain end Feed Stocks, April 1, 1947 


Winter wheat acreage planted and renaining for harvest 


Sone of the following topics also may be included: 


9. 
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13. 


Housinz and building construction 

Medical eare and availability of facilities. 

Educstion cxpenscs. 

Farm practices and use of modern technologicel devices and procedures. 


Agricultural prices. 


even Uc Jn 
* In July the first six topics planned’ for April will be repeated and sone of the 
following topics included: | | a 
1. Livestock itens csrricd on June Rural Cerricr Livestock Survey. oe ah 


2, Form Mortgee debb, interest rate anc type of lender: 


3. Short-term credit. ’ | a i 


4, Farm practices including use of fertilizer and‘ line, conservation 
prectices, regionalized to sare extent. 


5. Methods of Marketing. 
6. Agricultural prices. 


In October 1947 it is planned to teke a najor sanple for which the schedule 
would, in addition to the first six topics used in April and July, place 
primery emphasis on such tonics as -- 


1. Land utilization 


2. Acreage and production of important crops 


3. Livestock items designed to get size of fall pig crop and breeding intentions. 


yf 


4, Lend ownership _ fy 


5. Farm field practices and use of modern technovogical devices and procedures. 
6. Agriculturel prices. 
On Thursday afternoon further considerstion will be given to the January 1947 


Enunerative Survey —- design of the semple, selection and training of inter— 
viewers, end mininizing interviewer and respondent bias and refusals. 
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